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Abstract 

Objective To examine whether network meta-analyses, increasingly 
used to assess comparative effectiveness of healthcare interventions, 
follow the key methodological recommendations for reporting and conduct 
of systematic reviews. 

Design Methodological systematic review of reports of network 
meta-analyses. 

Data sources Cochrane Database of Systematic Reviews, Database 
of Abstracts of Reviews of Effects, Medline, and Embase, searched from 
inception to 12 July 2012. 

Review methods All network meta-analyses comparing clinical efficacy 
of three or more interventions based on randomised controlled trials, 
excluding meta-analyses with an open loop network of three 
interventions. We assessed the reporting of general characteristics and 
key methodological components of the systematic review process using 
two composite outcomes. For some components, if reporting was 
adequate, we assessed their conduct quality. 

Results Of 1 21 network meta-analyses covering a wide range of medical 
areas, 100 (83%) assessed pharmacological interventions and 1 1 (9%) 
non-pharmacological interventions; 56 (46%) were published in journals 
with a high impact factor. The electronic search strategy for each 
database was not reported in 88 (73%) network meta-analyses; for 36 
(30%), the primary outcome was not clearly identified. Overall, 61 (50%) 
network meta-analyses did not report any information regarding the 
assessment of risk of bias of individual studies, and 103 (85%) did not 
report any methods to assess the likelihood of publication bias. Overall, 
87 (72%) network meta-analyses did not report the literature search, 
searched only one database, did not search other sources, or did not 
report an assessment of risk of bias of individual studies. These 



methodological components did not differ by publication in a general or 
specialty journal or by public or private funding. 

Conclusions Essential methodological components of the systematic 
review process — conducting a literature search and assessing risk of 
bias of individual studies — are frequently lacking in reports of network 
meta-analyses, even when published in journals with high impact factors. 

Introduction 

Assessing the comparative effectiveness of many or all available 
interventions for a clinical indication is challenging. 1 Direct 
evidence from head to head trials is often lacking. 2 " 5 Indirect 
comparison between two interventions can still be estimated 
from the results of randomised controlled trials, without 
jeopardising the randomised comparisons within each trial, if 
each intervention is compared with an identical common 
comparator. 6 7 When both direct and indirect comparisons are 
available, the two sources of information can be combined by 
using network meta-analyses — also known as multiple 
treatments meta-analyses or mixed treatment comparison 
meta-analyses. 8 9 These methods allow for estimating all possible 
pairwise comparisons between interventions and placing them 
in rank order. 

In the past few years, network meta-analyses have been 
increasingly adopted for comparing healthcare interventions. 10 " 12 
Network meta-analyses are attractive for clinical researchers 
because they seem to respond to their main concern: determining 
the best available treatment. Moreover, national agencies for 
health technology assessment and drug regulators increasingly 
use such methods. 13 " 16 
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Several reviews previously evaluated how indirect comparisons 
have been conducted and reported. 7 1CM2 17 18 These reviews 
focused on checking validity assumptions (based on 
homogeneity, similarity, and consistency) and did not assess 
the key components of the systematic review process. Network 
meta-analyses are primarily meta-analyses, and should therefore 
be performed according to the explicit and rigorous methods 
used in systematic reviews and meta-analyses to minimise bias. 19 
We performed a methodological systematic review of published 
reports of network meta-analyses to examine how they were 
reported and conducted. In particular, we assessed whether the 
reports adequately featured the key methodological components 
of the systematic review process. 

Methods 
Search strategy 

We systematically searched for all published network 
meta-analyses in the following databases from their dates of 
inception: Cochrane Database of Systematic Reviews, Database 
of Abstracts of Reviews of Effects, Medline, and Embase. 
Search equations were developed for each database and were 
based partly on search terms used by Song and colleagues 12 and 
Salanti and colleagues 2 " (web table 1). The equations were based 
on specific free text words pertaining to network meta-analyses 
or overviews of reviews. The date of the last search was 12 July 
2012. We also screened the references of methodology papers 
and reviews"" 17 21 and searched for papers citing landmark 
statistical articles through the Web of Science or SCOPUS 
database. 6 8 22 " 24 

Eligibility criteria 

All reports of network meta-analyses comparing the clinical 
efficacy of three or more interventions based on randomised 
controlled trials were eligible. We excluded reports of adjusted 
meta-analyses involving indirect comparisons (that is, an open 
loop network of three interventions) 10 13 17 as well as publications 
of methodology, editorial style reviews or reports, cost 
effectiveness reviews, reviews based on individual patient data, 
and reviews not involving human participants. We also excluded 
reviews not published in English, French, German, Spanish, 
and Italian. 

Selection of relevant reports of network 
meta-analyses 

Two reviewers (AB, LT) independently selected potentially 
relevant reports of network meta-analyses on the basis of the 
title and abstract and, if needed, the full text according to 
prespecified eligibility criteria. Disagreements were discussed 
to reach consensus. 

Data extraction 

A standardised form was used to collect all data from the 
original reports of network meta-analyses and supplementary 
appendices when available. We collected all data for 
epidemiological and descriptive characteristics and those 
pertaining to the key methodological components of the 
systematic review process. Two reviewers (AB, RS) 
independently extracted all data from a random sample of 20% 
of reports. From all reports, two reviewers (AB, RS) 
independently extracted data for items that involved subjective 
interpretation. The corresponding items were questions referring 
to participants, interventions, comparisons, and outcomes; the 
type of comparator; how reporting bias was assessed; the 



publication status of selected randomised controlled trials; and 
whether statistical assumptions (homogeneity, similarity, and 
consistency) were mentioned. Disagreements were resolved by 
discussion. 

General characteristics 

The following general characteristics were collected: journal 
name, year of publication, country of corresponding author, 
medical area, funding source, and type of interventions included 
in the network. We categorised journal types into general or 
specialty; we also identified journals with high impact factors 
(that is, the 10 journals with the highest impact factor for each 
medical subject category of the Journal Citation Reports 201 1). 
Regarding network typology, we collected the number of 
interventions, the number of comparisons conducted by at least 
one randomised controlled trial (that is, direct comparisons), 
and the number of randomised controlled trials included in the 
network. 

Reporting of key methodological components 
of the systematic review process 

According to PRISMA 25 and AMSTAR 26 guidelines, we assessed 
whether key methodological components were reported or not. 
In the introduction and methods sections of each report, these 
factors included: 

• Questions referring to participants, interventions, 
comparisons, and outcomes 

• Existence of a review protocol 

• Primary outcome explicitly specified in the article or 
abstract, in the primary study objectives, or as the only 
outcome reported in the article 27 

• Information sources including databases searched, 
electronic search strategy, date of last search and period 
covered by the search of each database, any other sources 
(conference abstracts, unpublished studies, textbooks, 
specialty registers (for example, the US Food and Drug 
Administration), contact with study authors, reviewing the 
references in the studies found or any relevant systematic 
reviews), ongoing studies searched, and any or no 
restrictions related to language or publication status (that 
is, published studies or any other sources or ongoing 
studies) 

• Methods for study selection and data extraction 

• Methods used for assessing risk of bias of individual 
studies, such as use of any scales, checklists, or domain 
based evaluation recommended by the Cochrane 
Collaboration, with separate critical assessments for 
different domains (that is, allocation concealment, 
generation of sequence allocation, blinding, incomplete 
outcome data, or selective reporting) 

• Methods to incorporate assessment of risk of bias of 
individual studies in the analysis or conclusion of review 
(that is, subgroup analysis, inclusion criteria, sensitivity 
analysis, or the grading recommendations assessment 
development and evaluation (GRADE)) 28 

• Methods to assess publication or reporting bias (statistical 
or graphical evaluation). 

Regarding the search strategy, we distinguished between a "de 
novo" search (a new comprehensive literature search) and a 
mixed search strategy (an initial search for systematic reviews 
complemented by an updated search of trials not covered by the 
search period of these systematic reviews). 
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In the results section, we assessed whether reports included the 
following components: 

• Study selection, including the number of studies screened, 
assessed for eligibility, and included in the review; with 
reasons for exclusions at each stage (for example, a 
PRISMA flowchart) and the list of studies included and 
excluded 

• Study characteristics, including a description of the trial 
network with the number of interventions and number of 
comparisons conducted by at least one randomised 
controlled trial (that is, direct comparisons), characteristics 
of patients (for example, age, sex, disease status, severity), 
duration of follow-up of patients and duration of 
interventions, description of interventions, number of study 
groups and patients, and funding sources 

• Risk of bias within studies 

• Risk of bias across studies (publication bias). 

Finally, we assessed whether the discussion section included: 

• A limitation regarding reporting bias 

• Whether the authors mentioned or discussed the 
assumptions required in network meta-analyses (based on 
homogeneity, similarity, consistency, and exchangeability) 

• Whether authors mentioned a conflict of interest. 

Conduct quality when the reporting was 
adequate 

When items were adequately reported, we subsequently assessed 
whether the conduct quality was adequate. We considered the 
following items as inadequate conduct: electronic search of only 
one bibliographic database, restricting study selection to 
published reports, lack of independent duplicate study selection, 
and lack of independent duplicate data extraction. 

Composite outcome assessing inadequate 
reporting or inadequate conduct quality 

To summarise data, we built two composite outcomes assessing 
inadequate reporting or inadequate conduct quality (when the 
reporting was adequate). The first composite outcome was based 
on guidelines from Li and colleagues. 29 Inadequate reporting or 
conduct quality was considered as one of the following: 

• The authors did not report a literature search, they reported 
an electronic search of only one bibliographic database, or 
they did not supplement their investigation by searching 
for any other sources 

• The authors did not report an assessment of risk of bias of 
individual studies. 

The second composite outcome was defined as an all or none 
approach, based on seven methodological items identified as 
mandatory according to the methodological expectations of 
Cochrane intervention reviews. 30 Conduct or reporting quality 
was considered inadequate if: 

• The authors did not report questions referring to 
participants, interventions, comparisons, and outcomes 

• The authors did not report eligibility criteria 

• The authors did not report a literature search; they reported 
an electronic search of only one bibliographic database; or 
they did not supplement their investigation by searching 
for references in studies found, any relevant systematic 
reviews, or ongoing studies (for example, clinicaltrials.gov 
or the World Health Organization International Clinical 
Trials Registry Platform) 



• The authors did not report the methods of study selection 
and the data extraction process, or they reported inadequate 
methods 

• The authors did not report the results of the selection of 
primary studies 

• The authors did not provide a description of the primary 
studies 

• The authors did not report an assessment of the risk of bias 
of individual studies. 

Statistical analysis 

Quantitative data were summarised by medians and interquartile 
ranges, and categorical data summarised by numbers and 
percentages. We compared general characteristics and reporting 
of key items for network meta-analyses with results published 
in general and specialty journals and with public and private 
funding sources. All or none measurements were analysed by 
X 2 tests for categorical data. All tests were two sided, and P<0.05 
was considered significant. Statistical analyses involved use of 
SAS version 9.3 (SAS Institute). 

Results 

General characteristics 

Our search identified 1226 citations, including 333 duplicate 
citations. Among the 893 potentially relevant publications, 118 
were eligible reports of network meta-analyses. Three additional 
network meta-analyses were identified from methodological 
articles, resulting in 121 eligible reports of network 
meta-analyses (figs 111 and 211; web table 2 shows the main 
characteristics of the network meta-analyses™ 1 "™ 121 ). 

Reports of network meta-analyses were published in 75 different 
journals, with 55 reports (45%) published in general journals, 
66 (55%) in specialty journals, and 56 (46%) in journals with 
a high impact factor (table ljj; web table 3). The network 
meta-analyses covered a wide range of medical areas, and 100 
(83%) described the assessment of pharmacological 
interventions. The median number of interventions assessed per 
network meta-analysis was seven (interquartile range 5-9), and 
the median number of randomised controlled trials included per 
network meta-analysis was 22 (15-40). 

Reporting of key methodological components 
of the systematic review process 

Only three (2%) network meta-analyses did not report the 
databases searched in the methods section; of the remaining 
1 18, 99 (82%) used a de novo search strategy and 19 (16%) a 
mixed search strategy. However, 42 (35%) did not report 
searching other sources, and 39 (32%) did not report any 
information regarding restriction or no restriction of study 
selection related to publication status (table 2JJ ). In addition, 42 
(35%) and 32 (26%) network meta-analyses did not report the 
methods used for study selection and data extraction, 
respectively. A total of 61 (50%) network meta-analyses did 
not report any information regarding the assessment of risk of 
bias of individual studies. Of 121 network meta-analyses, 103 
(85%) did not report any methods to assess the likelihood of 
publication bias. 

In the results section, 95 (79%) network meta-analyses did not 
describe the characteristics of primary studies (that is, 
characteristics of the network, patient characteristics, and 
interventions); 70 (58%) did not report the risk of bias 
assessment within studies. 
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The similarity and consistency assumptions were not frequently 
mentioned in network meta-analyses (66% (n=80) and 44% 
(n=63) of reports, respectively; table 2). These findings did not 
differ by journal type or funding source (web table 4). 

Conduct quality when the reporting was 
adequate 

For network meta-analyses with adequate reporting, the conduct 
quality was frequently inadequate: 1 1% of these network 
meta-analyses involved a search of only one bibliographic 
database, 20% restricted the study selection to published articles, 
43% lacked an independent duplicate study selection, and 21% 
lacked an independent extraction of duplicate data. These 
findings did not differ by journal type or funding source (table 
3JJ.; web table 5). 

Composite outcome assessing inadequate 
reporting or inadequate conduct quality 

Overall, 87 network meta-analyses (72%) showed inadequate 
reporting of key methodological components or inadequate 
conduct quality according to guidelines from Li and colleagues. 29 
This measurement did not differ by journal type (general journal, 
69% (95% confidence interval 57% to 81%); specialty journal, 
74% (63% to 85%); P=0.5) or funding source (public funding, 
67% (74% to 79%); private funding, 79% (67% to 90%); P=0.2). 

We used a second composite according to the seven mandatory 
items of methodological expectations of Cochrane intervention 
reviews. 30 Based on this composite, 120 network meta-analyses 
(99%) showed inadequate reporting of key methodological 
components or inadequate conduct. These findings did not differ 
by journal type or funding source. 

Discussion 

We identified 121 reports of network meta-analyses covering 
a wide range of medical areas. Key methodological components 
of the systematic review process were missing in most reports. 
The reporting did not differ by publication in a general or 
specialty journal or by public or private funding. 

Several guidelines have been developed to assess the 
methodological quality and reporting of systematic reviews and 
meta-analyses, 26 10 33 and according to all these guidelines, 
retrieving all relevant studies is crucial for the success of every 
systematic review. The literature search needs to be exhaustive 
and adequate to maximise the likelihood of capturing all relevant 
studies and minimise the effects of reporting biases that might 
influence the nature and direction of results. 34 36 More than half 
of our network meta-analyses failed to report exhaustive 
searches; for those with adequate reporting, 11% searched only 
one electronic database (web table 6). 

In addition, more than half of our network meta-analyses did 
not describe the characteristics of patients, the duration of 
follow-up or treatment, or the intervention. The lack of adequate 
reporting of the characteristics of primary studies raises several 
problems. Knowing precisely the type of intervention, 
characteristics, and duration of follow-up and treatment is a 
preliminary step for researchers and readers to assess the 
assumption of similarity required in network meta-analyses. 12 37 

An important step of the systematic review process is to assess 
the risk of bias of individual studies. 38 " 42 The risk of bias in 
individual studies could affect the findings of network 
meta-analyses. 43 However, 58% of our network meta-analyses 
did not report the risk of bias of individual studies in the results 
sections, and 84% did not report a method to incorporate 



assessment of risk of bias of individual studies in the analysis 
or conclusions of the review (web table 6). 

Publication bias could affect the results of meta-analyses and 
network meta-analyses. 44 " 47 This factor is all the more important, 
considering that we lacked the validated methods to detect or 
to appropriately adjust or exclude reporting bias in network 
meta-analyses. Moreover, reporting bias across trials could 
differentially affect the various comparisons in the network and 
modify the rank order efficacy of treatments. However, most 
of our network meta-analyses (85%) did not report a method to 
assess the publication bias. Although reporting bias could have 
a substantial effect on the conclusions of a network 
meta-analysis, it is probably neglected. 

Strengths and limitations of study 

To the best of our knowledge, no study investigated the 
systematic review process in network meta-analyses (mixed 
treatment, comparison meta-analyses). 1 " 13 Recently, the Agency 
for Healthcare Research and Quality assessed the statistical 
methods used in a sample of published network meta-analyses, 
but did not analyse the conduct and reporting of the systematic 
review process. 48 

Our study had some limitations. Assessing conduct quality from 
published reports alone could be unreliable, as has been shown 
for randomised trials. 4 ' The study authors may have used 
adequate methods but omitted important details from their 
reports, or key information may have been deleted during the 
publication process. However, we were in the position of the 
reader, who can only assess what was reported. In addition, we 
judged that the conduct quality was inadequate only if the 
reporting was adequate. Furthermore, we did not assess health 
technology assessment reports, which could have had higher 
quality or precision than the reports analysed. 

Conclusions and implications 

Our study identified some important methodological components 
in the reports of network meta-analyses that may raise doubts 
about the confidence we could have in their conclusions. 
Potential flaws in the conduct of network meta-analyses could 
affect their findings. Performing a network meta-analysis outside 
the realm of a systematic review, without extensive and thorough 
searches for eligible trials, and without risk of bias assessments 
of trials, would increase the risk of a network meta-analysis 
producing biased results. Guidelines are needed to improve the 
quality of reporting and conduct of network meta-analyses. 
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What is already known on this topic 

Network meta-analyses are primarily meta-analyses, and should be conducted by respecting the methodological rules of systematic 
reviews 

Network meta-analyses are subject to the same methodological risks of standard pairwise systematic reviews, and because this method 
in network meta-analyses is complex, it is probably more vulnerable to these risks 

What this study adds 

Key methodological components of the systematic review process are frequently inadequately reported in publications of network 
meta-analyses 

The level of inadequate reporting does not differ between reports published by a general or specialty journal or between reports with 
public or private funding 

Inadequate reporting of results of network meta-analyses raises doubts about the ability of network meta-analyses to help clinical 
researchers determine the best available treatment 
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Tables 



Table 1| Epidemiological and descriptive characteristics of 121 reports of network meta-analyses 



Item and subcategory 


No (%) of reports 


Journal type 


General journal 


55 (45) 


With high impact factor 


29 (53) 


Specialty journal 


66 (55) 


With high impact factor 


27 (41) 


Location of corresponding author 


Europe 


69 (57) 


North America 


38 (31) 


Asia 


8(7) 


South America 


3(2) 


Oceania 


3(2) 


Funding source 


Private 


41 (34) 


Public 


40 (33) 


None 


15(12) 


Both private and public 


7(6) 


Unclear 


18 (15) 


Medical area 


Cardiology 


27 (22) 


Rheumatology 


16 (13) 


Endocrinology 


12 (10) 


Oncology 


10(8) 


Infectious disease 


9(7) 


Psychiatry/psychology 


8(7) 


Neurology 


8(7) 


Respiratology 


6(5) 


Ophthalmology 


5(4) 


Surgery 


5(4) 


Other (<3 reviews per medical area; 1 1 medical areas) 


15(12) 


Type of intervention assessed 


Pharmacological intervention 


100 (83) 


Different class * 


72 (60) 


Same class * 


35 (29) 


Any dose of same drug * 


12 (10) 


Non-pharmacological intervention 


11 (9) 


Devices * 


10(8) 


Surgery or procedure * 


7(6) 


Therapeutic strategy or education 


5(4) 


Both (pharmacological and non-pharmacological intervention) 


10(8) 


Type of network 


No of interventions assessed per networkt 


7 (5-9) 


No of comparisons conducted by at least one randomised controlled trial (per network meta-analysis)t 


10 (6-15) 


No of network meta-analyses with at least one closed loop 


103 (85) 


No of randomised controlled trials included in network meta-analysis (per network meta-analysisjt 


22 (15-40) 



Data are no (%) of reports unless stated otherwise. 
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Table 1 (continued) 



Item and subcategory 


No (%) of reports 


•Multiple answers were possible, so the total does not equal 100%. 




tData are median (interquartile range). 
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Table 2| Reporting of key methodological components of the systematic review process in network meta-analyses, by journal type 


Items 


Overall (n=121) 


General journals (n=55) 


Specialty journals (n=66) 


Introduction 


Questions referring to participants, interventions, comparisons, outcomes, and 
study design 


110 (91) 


51 (93) 


59 (89) 


Methods 


Existence of systematic review protocol 


15(12) 


9(16) 


6(9) 


Primary outcome(s) 


85 (70) 


44 (80) 


41 (62) 


Information sources searched 


Databases searched 


118(98) 


53 (96) 


65 (98) 


Electronic search strategy for each database 


33 (27) 


19 (35) 


14(21) 


Date of last search for each database 


109 (90) 


50 (91) 


59 (89) 


Period covered by search for each database 


83 (69) 


36 (65) 


47 (71) 


Search for any other sources (conference abstracts, unpublished studies, 
textbooks, specialty registers, contact with study authors, reviewing the 
references in the studies found or any relevant systematic reviews) 


79 (65) 


38 (69) 


41 (62) 


Reviewing the references in the studies found or any relevant systematic 
reviews 


54 (45) 


27 (49) 


27 (41) 


Search for ongoing studies 


19 (16) 


13 (24) 


6(9) 


Restriction or no restriction related to language 


92 (76) 


42 (76) 


50 (76) 


Restriction or no restriction related to the publication status 


82 (68) 


38 (69) 


44 (67) 


Study selection and data collection process 


Process for selecting studies 


79 (65) 


35 (64) 


44 (67) 


Method of data extraction 


89 (74) 


42 (76) 


47 (71) 


Methods used for assessing risk of bias of individual studies 


60 (50) 


27 (49) 


33 (50) 


Methods to incorporate assessment of risk of bias of individual studies in the analysis or conclusions of review 


Subgroup analysis 


9(7) 


4(7) 


5(8) 


Inclusion criteria 


4(3) 


1 (2) 


3(5) 


GRADE 


4(3) 


4(7) 


0(0) 


Adjustment 


2(2) 


2(4) 


0(0) 


Any of these methods 


19 (16) 


1 1 (20) 


8(13) 


Assessment of risk of bias that may affect the cumulative evidence (publication 
bias) 


18 (15) 


11(20) 


7(11) 


Results 


Study selection 


No of studies screened, assessed for eligibility, and included in the review 


90 (74) 


43 (78) 


47 (71) 


List of studies included 


117 (97) 


53 (96) 


64 (97) 


List of studies excluded 


9(7) 


6(11) 


3(5) 


Study characteristics 


Description of network 


82 (68) 


39 (71) 


43 (65) 


Characteristics of patients (for example, age, female:male ratio) 


70 (58) 


30 (55) 


40 (61) 


Duration of follow-up of patients 


60 (50) 


26 (47) 


34 (52) 


Duration of interventions 


34 (28) 


15(27) 


19 (29) 


Description of interventions 


64 (53) 


30 (55) 


34 (52) 


No of study groups 


95 (79) 


42 (76) 


53 (80) 


No of patients 


97 (80) 


41 (75) 


56 (85) 


Funding source 


13(11) 


8(15) 


5(8) 


Risk of bias within studies 


51 (42) 


23 (42) 


28 (42) 


Risk of bias across studies (publication bias) 


18 (15) 


1 1 (20) 


7(11) 


Discussion 


Reporting of limitations at review level (reporting or publication bias) 


58 (48) 


32 (58) 


26 (39) 
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Table 2 (continued) 



Items 


Overall (n=121) 


General journals (n=55) 


Specialty journals (n=66) 


Other items 


Assumptions required in network meta-analysis 


Homogeneity assumption 


107 (88) 


50 (91) 


57 (86) 


Similarity assumption 


41 (34) 


18 (33) 


23 (35) 


Consistency or exchangeability assumption 


58 (48) 


32 (58) 


26 (39) 


Conflict of interest 


95 (79) 


47 (85) 


48 (73) 



Data are number (%) of reports featuring the corresponding item. 
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Table | Inadequate quality of conduct of the systematic review process with adequate reporting in network meta-analyses, by journal type 


Item (reported and of inadequate quality of conduct) 


Overall 


General journal 


Specialty journal 


Electronic search of only one bibliographic database 


13/118 (11) 


8/53 (15) 


5/65 (8) 


Restriction of study selection based on publication status 


16/82 (20) 


6/38 (16) 


10/44(23) 


Lack of independent duplicate study selection 


34/79 (43) 


13/37 (35) 


21/42 (50) 


Lack of independent duplicate data extraction 


19/89 (21) 


10/41 (24) 


9/48 (19) 


Data are number (%)/total number of reports. Denominators of fractions indicate the total number of reports in which the corresponding item was reported. 
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Figures 



Citations retrieved (n=1226): 
CDSR (n=325), Medline (n=332), DARE (n=110), Embase (n=459) 



— »- Duplicate citations removed (n=333) 

Potentially relevant publications (n=893) 

Excluded on basis of title and abstract (n=602): 
Did not apply NMA process (n=360) 
Protocols (n=112) 
Methodological articles (n=93) 
— »- Abstracts and posters for congresses (n=23) 
Cost effectiveness reviews (n=9) 
Letters and editorials (n=3) 
Did not compare interventions (n=l) 
Not human participants (n=l) 

Articles (n=291) 



Excluded on basis of full text (n=173): 
Abstracts and posters for congresses (n=83) 
Cost-effectiveness reviews (n=51) 
Did not apply NMA process (n=14) 
Methodological articles (n=6) 
Included non-RCTs (n=6) 
Letter or editorial (n=5) 
Based on individual patient data (n=3) 
Non-English language (n=2) 
Full text not available (n=l) 
Indirect comparison (n=l) 
Included non-therapeutic intervention (n=l) 

Articles (n=118) 

Additional references identified 
in methodology articles (n=3) 



Eligible articles (n=121) 



Fig 1 Flowchart of selection of network meta-analyses. CDSR=Cochrane Database of Systematic Reviews; DARE= 
of Abstracts of Reviews of Effects; NMA=network meta-analysis; RCT= randomised controlled trial 
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Fig 2 Number of reports of network meta-analyses published per year. *We estimated the number of reports published 
from July to December 201 2 on the basis of the number of published network meta-analyses from the six previous months. 
Between January and June 2012, 27 reports were published (dark region); therefore, we estimated 27 reports from July to 
December 2012 (light region) 
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